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THE RELATIONSHIP OF UNDERGRADUATE MAJOR 
TO GENERAL KNOWLEDGE SCORES 

Gerald E. DeMauro 
Educational Testing Service 

ABSTRACT 

Scores from the October 1986 and March 1987 national administrations 
of the NTE Test of General Knowledge were analyzed to determine if area of 
undergraduate major was related to performance on the four sections of the 
test. To control for the range of skills associated with different reasons 
for taking the test, self-reported cumulative undergraduate grade point 
average was used as a covariate in the analyses. Results for both adminis- 
trations supported the construct validity of the test. The highest scores 
on the literature and fine arts sections were achieved by humanities 
majors, social science majors achieved the highest scores on the social 
studies section, and natural science (including math, physical science and 
geological science) majors achieved the highest scores on the math and 



science sections 



THE RELATIONSHIP OF UNDERGRADUATE MAJOR 
TO GENERAL KNOWLEDGE SCORES 



The Core Battery of the National Teachers Examination comprises tests 
of Commup.icacion Skills, of General Knowledge, and of Professional Knowl- 
edge. The Test of General Knowledge is taken by examinees who are more 
varied in their educational backgrounds than the examinees who take either 
the Test of Communication Skills or the Test of Professional Knowledge. 

In some states, e.g.. New Jersey and California, the Test is a certification 
requirement for teachers who were not education majors or who were not 
enrolled in state approved teacher preparation programs. As a consequence, 
many non-education majors also take the test as a requirement of varied 
“alternate route" programs. 

The Test of General Knowledge has sections in literature and fine 
arts, social studies, mathematics, and science. One measure of construct 
validity of the instrument would be to demonstrate that examinees who have 
differential exposure to courses in these areas score differently. Since 
the undergraudate major of examinees is collected on the answer sheet, an 
analysis of differential scoring was conducted. 

Sample 

Scores from the October 1986 and March 1987 national administrations 
of the Core Battery were analyzed. Table 1 shows the categories of under- 
graduate majors that are collected on the answer sheets, as well as the 
specific majors within each category. Both first-time and retake examinees 
were included in the sample. Specific undergraduate majors cannot be 
separated from the broad categories shown in Table 1. 

Hypotheses 

1. Humanities majors would score highest in literature and fine arts; 
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Table 1 



Undergraduate Major Fields as Listed 
on the Answer Sheet 



Code 01 ~ Hunanitie s 



Code 02 - Natural Sciences (cont.) 



Art History 

Classics, Classical Language 
Comparative Literature 
Drama, Dramatic Arts 
Engli'ti Literature 

Far Eastern Languages and Literature 

Fine Arts, Art, Design 

French 

German 

Italian 

Linguist ics 

Modern Languages 

Music 

Near Eastern Languages and Literature 
Other Foreign Lanciuages 
Other Hunanities 
Philosophy 

Religion, Religious Studies 

Russian 

Spanish 

Speech 



Code 02 - Natural Sciences 
Anatomy 

Applied Mathematics 

Archeology 

Architecture 

Astronomy 

Audiology 

Bacteriology 

Biochemistry 

Biology, Biological Scii^ces 

Biophysics 

Botany 

Chemistry 

Dent istry 

Earth Science 

Engineering 

Entomology 

Forestry 



Genetics 

Geology 

Health Sciences 

Life Sciences 

Nfethematics 

Medicine 

Metallurgy 

Microbiology 

Mining 

Nursing 

Nutrition 

Occupational Therapy 

Oeanography 

Optometry 

Osteopathy 

Parasitology 

Pathology 

Pharmacology 

Pharmacy 

Physical Therapy 
Physics 
Physiology 
Premedicine 
Public Health 
Statistics 
Veterinary Medicine 
Zoology 

Code 03 - Social Sciences 

Af lo-American History 

American Civilization, American Studies 

American History 

Anthropology 

Corrmun icatlons 

Economics 

European History 

Geography 

Government 

History 

Industrial Relations and Personnel 
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Table 1 (cont.) 



Code 03 - Social Sciences 

International R Aions 
Latin American distory 
Law 

Other Social Science 
Political Science 
Prelaw 
Psychology 

public Administration 
Slavic Studies 
Social Psychology 
Social Studies 
Social Work 
Sociology 

Urban Development (Regional Planning) 



Code 04 Elementary Education 

Early Childhood 
Middle School 
Nursery School 
Primary School 



Code 05 - Practical Arts & Scienc 

Agriculture 
Child Care 
Computer Science 
Cooking 

Distributive Education 
Drafting 
Electronics 
Food Service 



Code 03 - Practical Arts & Science (cont.) 

Home Economics 

Industrial Arts 

Metal 

Plastics 

Printing 

Sewing 

Trade and Industrial Education 
Wood 



Code 06 " Business 

Accounting 

Administration 

Bookkeeping 

Data Processing 

Distributive Education 

Economics 

Management 

Shorthand 

Typing 



Code 07 Education -General 

Administration and Supervision 
Education Psychology 
Guidance and Counseling 
Library Media Specialist 
Physical Education 
Reading Specialist 
School Psychology 
Special Education 
Tests and Measurements 
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2. Social Science majors would score highest iTt social studi... 

3. Natural Science majors (which includes math majors) would score 
highest in mathematics; 

4. Natural Science majors would also score highest in science. 



Procedure 

The initial analysis, using general linear models, tests whatever 
undergraduate major predicts performance on the four sections of the Test 
of General Knowledge, as hypothesized above. Tukey post hoc contrasts 
were employed to determine the significance of pairwise comparisons of the 
means attained by examinees grouped by major in each of the four test 
sections. In Tables 4-7, significant differences among these means are 
indicated through the use of roman numerals. Means that are associated 
with the same roman numerals are not significantly different, while those 
that do not share the same roman numerals are significantly different. 

These analyses are limited by lack of control over different reasons 
for taking the test, for examinees with different majors. For example, we 
would expect that among education majors, a wider spectrum of ability in 
General Knowledge would be sampled than among non-education majors, since 
in many states, education majors must pass the Test of General Knowledge 
to become certified to teach. This factor would interact with whether 
non-education majors could be certified in the state where the test is 
administered. Even within states that use the test as a criterion for 
alternate route certification, there may be different attrac* ns for math 
majors to seek teacher certification, for example, than for business 
maj ors. 
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To control for the skills of the examinees » a second set of analyses 
were performed, in which undergraduate grade point average was treated as 
a covariate^ under the assumption that examinees that are more skilled in 
general knowledge would achieve higher undergraduate grade point averages#^ 
Grade point average is collected in five categories on the answer sheets. 
For the analyses, groups were collapsed as less than 2.5, 2.5-2.99, 

3.0-3.49, 3.5 and above. Tables 2 and 3 present the numbers of examinees 
for each major and grade point average grouping. 

Results and Discussion 

The highest scores on the subsections of the Test of General Knowl- 
edge were achieved by examinees with undergraduate majors that would 
logically prepare them better. The hypotheses are all supported in both 
sets of analyses. These findings provide evidence that performance on the 
different sections of the Test of General Knowledge is related to under- 
graduate major. Several likely explanations for this are: 

a) Undergraduate major is selected by students who are better skilled 
in the area, and the Test is sensitive to skill differences; 

b) Students of different majors have greater exposure to the subject 
matter, and therefore score differently; and/or 

c) Differential interest in the subject matter is related to both 
choice of undergraduate major and higher test scores. 



^The assumption is made here that grade point average has roughly the 
same interpretation for different majors. The gross classes of averages 
used in the analyses, while not supporting this assumption, are intended 
to limit the variation in meaning of grade point average, from major to 
maj or. 
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Recent analys^is show that, after controlling for grade point average, 
college grade level was not related to G-neral Knowledge scores* In these 
analyses, sophomore and freshmen students were collapsed into one group to 
increase the number of scores analyzed* Therefore, if explanation b is 
correct, perhaps the differential exposure comes before the junior year in 
college* 

If any of the explanations is correct, support is given to the sensi- 
tivity of the four sections of the test to differences in the preparedness 
and/or interest of the examinees* This, in turn, supports the contruct 
validity of the instrument* 
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Table 2 



Number and Percentage of Examinees by 
Undergraduate Grade Point Average and 
Major, October 1986 National Administration 



Ma,1or 






1 

1 

1 


0-2.49 


Grade Point Average 
1 1 
1 2.50-2.99 I 3.00-3.49 


3.50-4.00 


Total 


1. 


Himanities 


N 


1 

1 


115 


1 

1 


588 


979 


657 


2,339 






% 


1 


5.04 


\ 


25.11 


41.80 


28,05 


100.00 


2. 


Natural Sciences 


N 


1 

1 


122 


1 

1 

1 


526 


718 


374 


1,740 






% 


1 


7.01 


1 


30.23 


41.26 


21.49 


100.00 


3. 


Social Sciences 


N 


1 

1 


145 


1 

1 


577 


780 


375 


1,740 






% 


1 


7.73 


1 


30.74 


41.56 


19.98 


100.00 


4. 


Elementary Education 


N 


1 

1 


563 


1 

1 


1,996 


2,353 


1,286 


6,198 






% 


I 


9.09 


1 


32.22 


37.99 


20.70 


100.00 


5 ^ 


Practical Arts and Science 


N 


1 

1 


47 


1 

1 


174 


182 


63 


466 






% 


1 


10.09 


1 


37.34 


39.06 


13.52 


100.00 


6. 


Business 


N 


1 

1 


58 


1 

1 


199 


183 


106 


546 






% 


1 


10.62 


1 


36.45 


33.52 


19.41 


100.00 


7. 


General Educaticn 


N 


1 

1 


220 


1 

1 


703 


672 


312 


1,907 






% 


1 


11.54 


1 


36.86 


35.24 


16.36 


100.00 


8. 


Other 


N 


1 

1 


19 


1 

1 


72 


102 


56 


249 




■ 


X 


1 


7.63 


1 


28.92 


40.96 


22.49 


100.00 


9. 


Unknown 


N 


1 

1 


14 


1 

1 


33 


1 34 


13 


94 






% 


1 


14.89 


1 


35.11 


36.17 


13.83 


100.00 




Total 


N 


1 

1 


1,303 


1 

1 


4,868 


6,003 


3,242 


15,416 






X 


1 


8.47 


1 


31.58 


38.94 


21.01 


100.00 
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Table 3 



Nunber and Percentage of Examinees by 
Undergraduate Grade Point Average and 
^fajor, March 1907 National Administration 







1 




Grade Point Average 






Major 






0-2.49 


2.30-2.99 


3.00-3.49 


3.30-4.00 


Total 


1. 


Himanities 


N 


109 


721 


1,438 


903 


3,173 






% 


3.AA 


22.72 


45.32 


20.32 


100.00 


2. 


Natural Sciences 




123 


701 


904 


370 


2,378 






% 


3.17 


29.40 


CD 


23.97 


100.00 


3. 


Social Sciences 


N 


163 


731 


1,012 


369 


2,497 






% 


6.61 


30.08 


40.33 


22.79 


100.00 


A. 


Elementary Education 


N 


387 


2,386 


3,191 


1,703 


7,947 






% 


9.09 


32.22 


37.99 


20.70 


100.00 


5 ^ 


ractical Arts and Science 


N 


57 


211 


228 


99 


393 






% 


9.30 


33.46 


38.32 


16.64 


100.00 


6. 


Business 


N 


60 


216 


279 


113 


668 






% 


8.90 


32.34 


41.77 


16.92 


100.00 


7. 


General Education 


N 


240 


807 


091 


396 


2,414 






% 


9.94 


36.74 


36.91 


16.40 


100.00 


8. 


Other 


N 


10 


89 


119 


34 


280 






% 


6.43 


31.79 


42.30 


19.29 


100.00 


9. 


Unknown 


N 


20 


60 


1 60 


36 


184 






% 


10.07 


76.96 


1 32.61 


19.37 


100.00 




Total 


N 


1,379 


6,030 


1 

1 8,202 


4,323 


20,136 






% 


6.03 


29.93 


1 40.73 


22.47 


100.00 
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'planned corparisons; means not sharing the same Roman numeral grouping are significantly different. 
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.^PPENDIX A 



ANOVA SuTinary Tables: 

Section Totals on the test of 
General Knowledge, by 
Undergraduate Major, 

October 1986 National Administration 







Sum of 


Degrees of 


Mean 




Section 


Variable 


Squares 


Freedom 


Square 


F-Ratio 


Literature and Fire Arts 


Major 


32705.10 


8 


4088.14 


175. 70^^^ 




Error 


379090.97 


16293 


23.27^ 






Total 


411796.07 


16301 






Math 


Nbjor 


27240.97 


8 


3405.12 


162. 69^^^ 




Error 


341006.55 


16293 


20.93 






Total 


368247,52 


16301 






Science 


Major 


28006.71 


8 


3300.84 


223. 39^^^ 




Error 


255339.00 


16293 


15.67 






Total 


283345.72 


16301 






Social Studies 


Major 


34809.70 


8 


4351 .21 


271.78 




Error 


260851,44 


16293 


16.01 






Total 


295661.14 


16301 




• 



♦Exceeds the £ < .03 level of significance. 
♦♦Exceeds the £ < .01 level of significance. 
♦♦♦Exceeds the £ < .001 level of significance 








/PPENDIX A 



WOVA Simnary Tables; 
Section Totals on the test of 
General Knowledge, by 
Undergraduate Major, 

March 1987 National Administration 







Sum of 


Degrees of 


Mean 




Section 


Variable 


Squares 


Freedom 


Square 


F-Ratio 


Literature and Fire Arts 


Major 


43532.47 


8 


5441.56 


243. 73^^^ 




Error 


477536.12 


21389 


22.33 






Total 


521068.58 


21397 






Math 


Major 


45960.65 


8 


5745.08 


237 AS*** 




Error 


477252.42 


21389 


22.31 






Total 


523213.07 


21397 






Sc ience 


Major 


38058.80 


8 


4757.35 


2S7.7^*** 




Error 


353670.36 


21389 


16.54 






Total 


391729.17 


21397 






Social Studies 


Major 


51332.72 


8 


6416.59 


338.37 




Error 


405609.54 


21389 


18.96 






Total 


456942.26 


21397 







♦Exceeds the ^ < .05 level of significance. 
♦♦Exceeds the ^ < .01 level of significance. 
♦♦♦Exceeds the ^ < .001 level of significance 
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/^PENDIX 8 



ANCOVA Sunmary Tables: Section Totals on the 

Test of General Knowledge, by Undergraduate 
Major, Adjusted for Undergraduate Grade Point 
Average, October 1986 National Adkninistration 







Sum of 


Degrees of 


Mean 




Section 


Variable 


Squares 


Freedom 


Square 


F-Ratio 


Literature and Fine Arts 


Major 


23954.32 


8 


2994.29 


141.53*** 




GPA 


30308.57 


1 


30308.59 






Error 


325911.06 


15405 


21.16 






Total 


386444.40 


15414 







Math 


Major 


23166.06 


8 


2895.76 ^ 


149.08*** 




GPA 


18979.15 


1 


18979.15 






Error 


299220.92 


15405 


19.42 






Total 


343623.23 


15414 







Science 


Major 


24290.19 


8 


3036.27 


208. 03^^^^^^ 




GPA 


15884.22 


1 


15884.22 






Error 


224845.26 


15405 








Total 


267449.85 


15414 







Social Studies 


Major 


28923.77 


8 


3615.47 


244. 2 3^^^^^^ 




(PA 


17472.82 


1 


17472.82 






Error 


228044.38 


15405 








Total 


278068.23 


15414 







♦^^^Exceeds the 2 , < *001 level of significance. 
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/PPENOIX B 



ANCOVA Summary Tables: Section Totals on the 

Test of General Knowledge, by Undergraduate 
Major, Adjusted for Undergraduate Grade Point 
Average, March 1987 National Ackninistration 







Sun of 


Degrees of 


Mean 




Section 


Variable 


Squares 


Freedom 


Square 


F-Ratio 


Literature and Fine Arts 


Major 


32482.10 


8 


4060.26 


198.66*** 




GPA 


33542.42 


1 


33542.42 






Error 


411334.48 


20126 


20.44 






Total 


485341.40 


20135 







Math 


Major 


39566.40 


8 


4945.80 


237.83*** 




GPA 


24549.00 


1 


24549.00 






Error 


418537.80 


20126 


20.80 






Total 


486109.37 


20135 







Science 


Major 


30996.22 


8 


3874.53 


253.78*** 




GPA 


24046.19 


1 


24046.19 






Error 


307270.84 


20126 


15.27 






Total 


366596.14 


20135 







Social Studies 


Major 


43098.66 


8 


5387.33 


306.02*** 




GPA 


24195.50 


1 


24195.50 






Error 


354305.10 


20126 


17.60 






Total 


426892.05 


20135 







^♦♦Exceeds the £ < .01 level of significance. 
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